Image visualizing device

ABSTRACT

Electronic paper display comprises analyzer for a plurality of picture image data and controller for automatically changing the term, during which picture is visualized. Analyzer counts number of pictures in one month or one season to have controller automatically change the term per one picture to be visualized. Number of pictures for visualization is reduced when the term per one picture is less than one day. Analyzer checks the attribute data of picture to change the term for visualization. Controller substitutes a temporal anniversary picture for the regular calendar picture for a term and gets back regular picture upon expiration of the term. Electronic paper calendar prepares calendar layouts for horizontally long picture and vertically long picture, respectively, with picture sizes different from each other. Electronic paper calendar prepares calendar layout with even month arranged on the left side and odd month on the right side beneath common picture.

CROSS RELATION TO RELATED APPLICATION

This application is Continuation application of U.S. application Ser.No. 12/957,487, filed Dec. 1, 2010, which is a continuation-in-part ofU.S. application Ser. No. 12/951,142, filed Nov. 22, 2010, hereinincorporated by reference in its entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

This invention relates to an image visualizing device capable ofvisualizing digital image data into a picture on the basis of thedigital image data.

2. Description of the Related Art

In this field of the art, various attempts have been done with respectto image output devices such as digital cameras capable of capturing thedigital image data to output for visualization thereof and visualizingdevices such as display device or printer capable of displaying orprinting the pictures on the basis of the digital image data receivedfrom the image output devices.

For example, Japanese Publication No. 1998-108005 proposes to directlyconnect a printer to a digital camera for the purpose of utilizing theview finder of the digital camera to display the operation screen of theprinter for printing process, to display picture image for selecting theformat and the picture to be printed in the format, and to carry out theprinting in accordance with the selection.

On the other hand, Japanese Publication No. 2006-129371 proposes todisplay a calendar image including the beginning year and month withselected images put according to the preset initial template. Accordingto the template, the calendar of January, 2005 as the beginning year andmonth and the calendar of February, 2005 are displayed in a screen.

Further, Japanese Publication No. 2008-225562 proposes to automaticallydisplay a picture having shooting month corresponding to this month. Inmore detail, display screen of display unit displays year and monthinformation of the calendar, calendar principal part and calendardecoration part. At the decoration part of the calendar, a picturerelated to the year and month information, especially to the month, isdisplayed by means of retrieving the picture from memory. The picturemay be related to the current date of the month. For example, if animage related to wedding anniversary or birthday is selected when theday comes regardless of the year.

However, there still exist in this field of art many demands forimprovements of image visualizing devices.

SUMMARY OF THE INVENTION

Preferred embodiment of this invention provides an image visualizingdevice comprising a storage arranged to store digital image data of aplurality of pictures to be visualized, a display arranged to visualizeone of the plurality of pictures on the basis of the digital image dataretrieved from the storage, an analyzer arranged to analyze the digitalimage data of the plurality of pictures, and a controller arranged toautomatically change the term, during which the picture is visualized onthe display, in response to the analyzer. Thus, the pictures can beautomatically displayed in sequence each with a suitable term.

In a detailed design according to the above preferred embodiment, theanalyzer is arranged to automatically count the number of the pluralityof pictures, and wherein the controller is arranged to automaticallychange the term per one picture in accordance with the number of thepictures counted by the analyzer. According to this detailed design, theterm per one picture is suitably adjusted in accordance with the numberof the pictures. In more detailed design, the analyzer counts the numberof the plurality of pictures within a period. And, the controllerautomatically changes the term per one picture in accordance with thenumber of the pictures within the period. Therefore, a plurality ofpictures can be suitably displayed in sequence within the limitedperiod.

According to a still more detailed design of the above feature, thecontroller is arranged to automatically reduce the number of picturescapable of being visualized on the display when the term per one pictureis less than a limit due to an excessive number of the pictures withinthe period. Thus, suitable term per one picture is kept with excessivelyfrequent change avoided, which may otherwise irritate people living withthe visualizing device in the form of a calendar for instance. Anexample of the limit is one day, while an example of the period is onemonth.

According to another detailed design, the digital image data of apicture is related to attribute data, wherein the analyzer is arrangedto automatically check the attribute data, and wherein the controller isarranged to automatically change the term of visualizing the picture inaccordance with the attribute related to the picture checked by theanalyzer. Thus, a suitable term of display is assigned to each picturein accordance with its attribute for avoiding an unnaturally long orshort period.

According to still another detailed design, the analyzer is arranged toautomatically distinguish a temporal picture from a regular picture, andwherein the controller is arranged to automatically substitute thetemporal picture for the regular picture for a term and to get back theregular picture in place of the temporal picture when the term expires.Thus, the temporal picture, such as anniversary picture, can be timelyand suitably interposed in a regular picture, such as a calendar picturefor a month.

According to another detailed design, the image visualizing devicefurther comprises an output arranged to inform outside of thevisualizing device of the size of the picture on the display. Thisfeature is advantageous for getting picture image data from outsidesuitable for the display to visualizing the picture. In more detail, thesize of the picture is determined in accordance with the size of thedisplay and the layout for arranging the picture on display.Accordingly, the size of the picture is adequate information with thelayout for arranging the picture taken into consideration. A typicalexample of the layout is calendar layout with the picture incorporated.And, an advantageous example of the display is an electronic paperdisplay.

According to another feature of the preferred embodiment of thisinvention, an image visualizing device is provided, which comprises astorage arranged to store digital image data of a plurality of picturesto be visualized and calendar data, an electronic paper display arrangedto visualize a calendar with the picture incorporated in accordance witha calendar layout on the basis of the digital image data and calendardata retrieved from the storage, and a controller arranged to prepare afirst calendar layout for a horizontally long picture and a secondcalendar layout for a vertically long picture for automaticallyselecting one of the first and second calendar layouts in response towhether the picture incorporated in the calendar layout is horizontallylong or vertically long. In this feature, an electronic paper calendarwith a horizontally long picture and a vertically long picture aresuitably incorporated in the electronic paper calendar, respectively.

In a detailed design according to the above feature of the preferredembodiment, the size of the picture incorporated in the first layoutdiffers from that in the second layout. Thus, the horizontally longpicture and the vertically long picture are suitably incorporated in thecalendar with an optimum size, respectively.

In another detailed design according to the above feature of thepreferred embodiment, the number of months displayed in the first layoutdiffers from that in the second layout. Thus, the horizontally longpicture and the vertically long picture are suitably incorporated in theelectronic paper calendar in optimum layout with the number of monthssuitably taken into consideration, respectively.

According to still another feature of the preferred embodiment of thisinvention, an image visualizing device is provided, which comprises astorage arranged to store digital image data of a plurality of picturesto be visualized and calendar data, an electronic paper display arrangedto visualize a calendar with the picture incorporated in accordance witha calendar layout on the basis of the digital image data and calendardata retrieved from the storage, and a controller arranged to prepare acalendar layout with an even month calendar arranged on the left sideand an odd month calendar on the right side. Thus, the even monthcalendar and odd month calendar are naturally arranged accompanied bythe picture image in the electronic paper calendar. A typical andadvantageous example of the electronic paper calendar layout includes apicture area with one picture commonly arranged for two months and acalendar area with even month calendar and the odd month calendararranged side by side beneath the commonly arranged one picture.

In a detailed design according to the above feature of the preferredembodiment, the controller is arranged to further prepare anothercalendar layout with an odd month calendar arranged on the left side andan even month calendar on the right side. According to this detaileddesign, natural layout of two-month electronic paper calendaraccompanied by the picture image is realized throughout a year.

Other features, elements, arrangements, steps, characteristics andadvantages according to this invention will be readily understood fromthe detailed description of the preferred embodiment in conjunction withthe accompanying drawings.

The above description should not be deemed to limit the scope of thisinvention, which should be properly determined on the basis of theattached claims.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram showing a digital image enjoying systemincluding an image output device and image display device according tothe first embodiment of this invention.

FIG. 2 is an example of the calendar display on image display device, inwhich horizontally long picture is incorporated into the calendar layoutas a standard case.

FIG. 3 is another example of the calendar display on image displaydevice.

FIG. 4 is an example of the picture on monitor of image output device,in which FIG. 4(A) shows a basic calendar input window.

FIG. 5 is an example of the picture on monitor of image output devicefor confirming the details of the picture, in which FIG. 5(A) showsenlarged picture displayed on the monitor in full-screen mode with thelongitudinal direction of enlarged picture fitted to that of monitor forachieving the maximum enlargement, suitable rotation of enlarged pictureaccompanied if necessary for that purpose.

FIG. 6 is an example of the picture on monitor of image output devicefor explaining in detail the scroll of the enlarged partial image forcomprehending the entire image by means of persistence of vision.

FIG. 7 is a table showing a data format constructing the calendar imageof the first embodiment, including three groups which can be treatedindependently from each others, the three groups being layout datagroup, calendar data group and picture data group.

FIG. 8 is a flowchart showing the function carried out by cameracontroller of the first embodiment in FIG. 1.

FIG. 9 is a flowchart showing the detailed function of step S32 in FIG.8.

FIG. 10 is a flowchart showing the detailed function step S58 in FIG. 8.

FIG. 11 is a flowchart showing the detailed function of in step S70 inFIG. 9.

FIG. 12 is a flowchart showing the detailed function of theenlarge/scroll process in step S142 in FIG. 11.

FIG. 13 is a flowchart showing the detailed function of step S78 in FIG.9.

FIG. 14 is a flowchart showing the detailed function of step S216 inFIG. 13.

FIG. 15 is a flowchart showing the function carried out by displaycontroller in electronic paper display of the first embodiment in FIG.1.

FIG. 16 is a flowchart showing the detailed function of step S294 inFIG. 15.

FIG. 17 is a table showing a data format constructing the calendar imageof the second embodiment according to this invention.

FIG. 18 is a flowchart showing the function carried out by cameracontroller of the second embodiment according to the data format shownin FIG. 17.

FIG. 19 is a flowchart showing the detailed function of steps S332 andS334 in FIG. 18.

FIG. 20 is a flowchart showing the function carried out by displaycontroller of the second embodiment according to the data format shownin FIG. 17.

FIG. 21 is a flowchart showing the detailed function of steps S366 inFIG. 20.

FIG. 22 is a flowchart showing the detailed function of steps S408 inFIG. 21.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS First Embodiment

FIG. 1 is a block diagram showing a digital image enjoying systemincluding an image output device and image visualizing device accordingto the first embodiment of this invention. The first embodiment isformed as a combination of digital camera 2 as the image output deviceand electronic paper display 4 as the image visualizing device, in whichelectronic paper display 4 displays a calendar with the picture taken bydigital camera 2 incorporated therein. Electronic paper display 4 is ofan extremely thin structure type capable of being hanged on a wall, andincludes large size electronic paper monitor 6 which is rewritable andcapable of keep an image with the power shut off. The size of electronicpaper monitor display 6 is similar to that of a conventional papercalendar hanged on the wall.

In case of taking a picture for use in creating a calendar, digitalcamera 2 is aimed at a desired object so that image pickup 8 including alens and an image sensor faces to the object. The image of the object iscaptured by image pickup 8 and displayed on monitor 11 by way of imageprocessor 10. Thus, monitor 11 is observed to determine the compositionof the object to push a shutter release button in operating portion 13.In response to the shutter release, the image of the object captured byimage pickup 8 in compressed at compressor/decompressor 12 by way ofimage processor 10 to be stored into internal storage 14. According tosuitable manners, the compressed image data stored in internal storage14 is transmitted to removable card storage 20 inserted in card slot 18.Or, alternatively the compressed image data from compressor/decompressor12 may be directly transmitted to removable card storage 20. The factthat the stored image data is specially taken for the purpose ofcreating a calendar is marked by means of an operation at operatingportion 13, the mark data being attached to the compressed image datafor easily distinguishing such a specially taken image data. Camerafunctions of digital camera 2 including the above mentioned picturetaking are controlled by camera controller 21 including a microcomputer.Memory 23 stores programs necessary for camera controller 21 to controlthe camera function as well as various data necessary for the control.Clock 33 functionally included in camera controller 21 attaches a timestamp to the compressed image data to identify the date and time whenthe picture was taken. GPS (Global Positioning System) unit 25 attachesposition information to the compressed image data to identify the placewhere the picture was taken.

Removable card storage 20 removed from card slot 18 of camera I/O(Input/output) 16 can be inserted into card slot 24 at display I/O 22 ofelectronic paper display 4 for inputting the image data into electronicpaper display 4 for calendar creation. Or, alternatively, the image datastored in internal storage 14 or removable card storage 20 in card slot18 can be inputted into electronic paper display 4 through datacommunication between cable I/O 26 or wireless I/O 28 in camera I/O 16and cable I/O 30 or wireless I/O 32 in display I/O 22. As will bementioned later in detail, the data communication between camera I/O anddisplay I/O 22 is by directional to allow data transmission fromelectronic paper display 4 to digital camera 2. Broken arrow 34 betweencamera I/O 16 and display I/O 22 shows such a bidirectional datatransmission.

Now, the manner of creation and display of calendar are to be explained.Calendar creation data storage 36 stores calendar layout data and datedata for a plurality of years, e.g., ten years, including year data,month data and days of the week data with country-by-country holidaydata as well as picture data to be arranged in accordance with thecalendar layout. Upon creation of a calendar, one of calendar layouts isinitially selected by an operation at operating portion 13 among alayout list displayed on monitor 11. In response to the selectingoperation from the list, the layout image corresponding to the selectedlayout is displayed on monitor 11 on the basis of layout data stored incalendar creation data storage 36.

For fitting a picture in the selected calendar layout displayed onmonitor 11, operating portion 13 is to be operated to retrievethumbnails relating to the image data with calendar mark from internalstorage 14 or removable card storage 20 for displaying the thumbnails onmonitor 11. A desired one of the thumbnails displayed on monitor 11 isto be selected by means of operating portion 13, and the picture relatedto the selected thumbnail is retrieved from internal storage 14 orremovable card storage 20 and displayed on monitor 11 by way ofdecompression at compressor/decompressor 12. The size of monitor 11 islimited within the contour size of digital camera 2, which means thatthe largest size of the whole picture capable of being displayed onmonitor 11 is limited even if the whole picture is enlarged to itsmaximum within monitor 11. In other words, the details of the picture ishardly observed by means of whole picture displayed on monitor 11whereas the size of electronic paper monitor 6 is so large that adigital picture of similar size to that of the picture of theconventional paper calendar can be displayed. Therefore, it is necessaryto confirm whether or not the detailed focus and definition in theselected picture is sufficient for display on such an enlargement onelectronic paper display 4.

For the above mentioned purpose of details confirmation, calendarcreation data storage 36 stores the information of the size ofelectronic paper monitor 6 peculiar to electronic paper display 4. Thescale of enlargement for displaying the picture on monitor 11 with theactual size just the same as that of the picture to be displayed onelectronic paper monitor 6 is calculated on the basis of the stored sizeof electronic paper monitor 6, the rate of the area occupied by pictureto the entire area of the selected calendar layout and the image size ofthe picture taken and selected. Naturally, the enlarged picture onmonitor 11 is a part trimmed from the entire picture. The confirmationprocess above will be discussed later in more detail.

Monitor 11 includes touch panel 38 for operation. For example, if adesired point of whole picture displayed on monitor 11 is touched, touchpanel senses the touched position on displayed picture. In response tothe sense of touch panel 38, the enlargement of the picture according tothe above mentioned detail confirmation is carried out centered on thetouched position. In other words, the enlargement of the picture iseasily carried out centered on a portion in question. This manner ofenlargement will also be discussed later in more detail.

Acceleration sensor 40 is prepared for causing to scroll the picture toview areas of the enlarged picture not appearing in monitor 11. In otherwords, if digital camera 2 is moved in parallel with monitor 11, themovement is detected by acceleration sensor 40 to scroll the enlargedpicture within monitor 11 toward the direction opposite to the movementof digital camera for example. This means that monitor 11 moves tochange the viewable area on the enlarged picture, the absolute positionof which substantially kept stationary. Thus, the desired scrollingmotion can be easily caused with the stationary entire enlarged picturecomprehensive by means of persistence of vision. This manner ofscrolling will be discussed later in more detail.

If the picture to be arranged in the selected calendar layout isdetermined in accordance with the above explained selection andconfirmation procedure, image editor 42 combines the selected pictureimage data from compressor/decompressor 12 with the calendar data whichcamera controller 21 retrieves from calendar creation data storage 36 tocomplete calendar image data to be displayed on monitor 11. Thecompleted calendar image data is compressed throughcompressor/decompressor 12 to be stored in internal storage 14 orremovable card storage 20 for transmission to electronic paper display 4by way of camera I/O 16. By means of combining the picture image datawith calendar data including year, month and days of week to completethe calendar image within digital camera 2 in accordance with a similardigital format to that of a simple picture image, even a simple digitalphoto frame capable of only displaying a transmitted image data as it isor a simple printer capable of only printing a transmitted image data asit is can display or print a completely edited calendar. However,electronic paper display 4 according to the first embodiment in FIG. 1can not only display the completely edited calendar transmitted fromdigital camera 2, but also can receive from digital camera 2 theuncombined components of the calendar including picture image data,calendar data of year, month and days of week, the calendar layout dataas they are to combine the components within electronic paper display 4by itself. For the purpose of such cooperation with electronic paperdisplay 4, digital camera 2 keeps the uncombined components of thecalendar as well as the completed calendar image data. The cooperationbetween digital camera 2 and electronic paper display 4 above will bediscussed later in more detail.

Electronic paper display 4 stores the calendar image data received atdisplay I/O 22 into data storage 44. In the case of data reception bymeans of inserting removable card storage 20 into card slot 24,removable card storage 20 itself may keep the calendar image data incard slot 24. In the case of data reception in the form of uncombinedcomponents of calendar, image processor 46 retrieves the component datafrom data storage 44 for combining them into the complete calendar imagedata to transmit it to image memory 48. On the other hand, if the datareception in the form of the complete calendar image data, imageprocessor 46 simply passes the complete calendar data as it is to imagememory 48. Driver 50 writes or overwrites the new calendar on electronicpaper monitor 6 in response to the calendar image data newly transmittedto image memory 48. Electronic paper monitor 6 keeps the new calendardisplayed thereon even if the power is shut off with the new calendarcompletely written or rewritten.

The above and other functions of electronic paper display 4 arecontrolled by display controller 52 including a microcomputer. Memory 54stores programs necessary for display controller 52 to control thefunctions as well as various data necessary for the control. Clock 54functionally included in display controller 52 for checking the changein date detects the change in month to cause the rewriting function ofdisplay controller 52. In other words, display controller 52 has driver50 automatically rewrite electronic paper monitor 6 into a new calendardisplay every new month on the basis of the new month calendar imagedata retrieved from data storage 44 by way of image processor 46 andimage memory 48, the future month calendar image data being previouslyreceived from digital camera 2 and stored in data storage 44. Datastorage 44 also prepares and stores by itself default future calendarimage data for realizing the automatic calendar update in every month incase the custom calendar image data is failed to be previously receivedfrom digital camera 2. The automatic update of calendar above will bediscussed later in more detail.

Electronic paper monitor 6 includes touch panel 56 for directlyinputting comment or noted with hand-written characters or marks by afinger or a touch pen on the displayed calendar. The character or marksensed by touch panel 56 is to be displayed on electronic paper monitor6 in such manner that the character or the mark is superimposed as it ison the displayed calendar on electronic paper display. The image ofcharacter or mark sensed by touch panel 56 may be transmitted to digitalcamera 2 for identifying the character or mark by means of OCR (OpticalCharacter Reader) 53 functionally included camera controller 21. Inother words, OCR 58 identifies the image data of character or mark totransform it into code data. It should be noted that the image ofcharacter or mark is sensed by touch panel 56 according to the firstembodiment in contrast to that the image of character or mark is sensedby optical image sensor in the case of typical OCR. The code data ofcharacter or mark is to be transmitted back to electronic paper display4 as a data for combining the corresponding character or mark of astandardized font with the calendar image data instead of thehand-written character or mark as it is. Thus, a comment or note such asevent information in long term use can be input not only at digitalcamera 2, but also at electronic paper display 4 directly on the surfaceof electronic paper monitor 6. The addition of comment or note abovewill be discussed later in more detail. In any case, the area ofelectronic paper monitor 6 is so larger that a hand writing of finecharacter of mark is possible on electronic paper monitor 6, similarhand writing being impossible on monitor 11 of digital camera 2 ofremarkably smaller area.

FIG. 2 is an example of the calendar display on electronic paper monitor6 of electronic paper display 4, in which horizontally long picture isincorporated into the calendar layout as a standard case. According tothe standard layout in FIG. 2, horizontally long picture 62 is locatedat the upper half of the calendar layout beneath year indication 64. Onthe other hand, calendar 66 for two months including month and days ofweek. According to the first embodiment, the calendar image displayed onelectronic paper display 6 is rewritten every month. This means that acalendar for two months is possible in such a manner that the days ineven month, i.e., October, is located on the left side while the days inodd month, i.e., November, is located on the right side as in FIG. 2.The indication in FIG. 2 is in October. In November, the indication willbe automatically rewritten into such a new calendar image that the daysin November is shifted to the left side while the days in December arenewly displayed on the right side. On the other hand, horizontally longpicture 62 may be kept on if the contents of the picture suits for notonly October-November season, but also for October-November season. Oralternatively, horizontally long picture 62 may also be changed inaccordance with the change from the October-November calendar to theOctober-November calendar. Further, horizontally long picture 62 can bechanged any time in mid-flow of a month.

Among calendar 66, each of Sundays 68 is modified into boldface.Similarly, each of holidays 70 is modified to be encircled for example.The modification of day indications for Sundays and holidays are aboveautomatically carried out every year and month in accordance with thedata stored in calendar creation data storage 36. Displayed days inCalendar 66 are capable of being accompanied with additional statementsuch as fixed event data 72, e.g., personal anniversary data or freeevent data 74, e.g., schedule of a trip. In the case of the fixed eventdata 72, the additional statement once input will be carried on the nextyear and so on. On the contrary, the free event data 74 will not becarried on the next year, but is temporal for the year when theadditional statement is input.

FIG. 3 is another example of the calendar display on electronic papermonitor 6 of electronic paper display 4, which is basically similar tothat in FIG. 2. However, the calendar display in FIG. 3 incorporatesvertically long picture 82 into the calendar layout as another standardcase. In more detail, vertically long picture 82 is located at the upperhalf of the calendar layout beneath year indication 64. On the otherhand, calendar 84 for one month, e.g., December, including month anddays of week. Further, calendar 86 for previous month, e.g., November,is located to the left of vertically long picture 82, while calendar 88for following month, e.g., January of 2010, is located to the right ofvertically long picture 82. In the case of succeeding months cross overyears as in FIG. 3, indication of month 90 is automatically accompaniedwith year indication. Further, in this case, year indication 64 at thetop of electronic paper monitor 6 is automatically accompanied with nextyear indication 92. Hand-written free event data 94 is an example ofadditional statement input through touch panel 56 in FIG. 1 displayed inthe calligraphy sensed on touch panel 56 as it is. Thus, hand-writtenfree event data 94 can be input and indicated at the place of therelated day indication in the same manner as the case of writing acomment on a conventional paper calendar.

FIG. 4 is an example of the picture on monitor 11 of digital camera 2,in which FIG. 4(A) shows a basic calendar input window. According to thelayout of the basic calendar input window in FIG. 4( a), entire calendarlayout 102 in the process of creation is located at the left half of theinput window. At the upper-right portion of the input window, a group ofthumbnails 104 are indicated for selection of a picture to beincorporated in the calendar image, the thumbnail encircled by boxcursor 106 being selected and the corresponding picture 108 beingtemporarily indicated in entire calendar layout 102. At the lower-rightportion of the input window, various entry fields are indicated. Namely,ID entry fields 110 show that year calendar type number, e.g., “3” andcalendar layout type, e.g., “vertically long” are entered. Year/Monthentry fields 112 show that year, e.g., “2009” and month, e.g., “October”are entered. In response to the input at the entry fields, correspondingyear indication 114, month/days of week indication 116 appear in entirecalendar layout 102. Thus, the calendar image is basically created.

Fixed event data entry fields 118 show that date common to all years,e.g., “October 6” and note for the date, e.g., “birthday” of someone areentered. Similarly, free event data entry fields 120 show that schedulefor the year, e.g., “December 28 to 29” and note for the schedule, e.g.,“trip” are entered. A plurality of anniversaries or schedules fallingwithin the term, e.g. October to November, identified by Year/Monthentry fields 112, are capable of being entered at fixed event data entryfields 118 or free event entry fields 120 one after another which hasbeen entered. All the results of the event entry appear in entirecalendar layout 102 at corresponding day indications, respectively.

FIG. 4(B) shows a view on monitor 11 of digital camera 2, in whichentire calendar layout 102 in FIG. 4(A) is enlarged in full-screen mode.In this case, enlarged entire calendar layout 122 of vertically longlayout is rotated by 90 degrees for fitting the longitudinal directionof the calendar layout to that of monitor 11 for achieving the maximumenlargement. In observing such an enlarged display, digital camera 11itself is to be rotated back by 90 degrees for erecting the entirecalendar layout 122.

FIG. 5 is an example of the picture on monitor 11 of digital camera 2for confirming the details of the picture, in which FIG. 5(A) showsenlarged picture 132 displayed on monitor 11 in full-screen mode withthe longitudinal direction of enlarged picture 132 fitted to that ofmonitor 11 for achieving the maximum enlargement, suitable rotation ofenlarged picture 132 accompanied if necessary for that purpose. The viewin FIG. 5(A) is gotten by a predetermined operation at operating portion13 in FIG. 1 with the corresponding thumbnail encircled by box cursor106 in the condition shown in FIG. 4. In case that the confirmation bymeans of the enlargement in FIG. 5(A) is insufficient, monitor 11 is tobe touched by finger 134 at a point in question, and the view shown inFIG. 5(B) results in which enlarged trimming image 136 is displayed withthe touched point located at the center of monitor 11 in full-screenmode. As has been already mentioned, the scale of enlargement oftrimming image 136 is so calculated as to realize on monitor 11 theactual size of the picture to be displayed on electronic paper monitor6. The calculation is made on the basis of the size of electronic papermonitor 6, the rate of the area occupied by picture to the entire areaof the selected calendar layout and the image size of the picture to beincorporated into the calendar layout.

FIG. 6 is an example of the picture on monitor 11 of digital camera 2for explaining in detail the already mentioned scroll of the enlargedpartial image for comprehending the entire image by means of persistenceof vision. FIG. 6(A) and FIG. 6(B) are identical with FIG. 5(A) and FIG.5(B), in which entire picture is easily comprehensible but details areunclear in FIG. 6(A), while the part gotten by trimming is clear butentire picture is not comprehensible. FIG. 6(C) shows a way to take carethe above antinomy, in which digital camera 2 is moved in parallel withmonitor 11. In other words, digital camera 2 is rapidly and repeatedlymoved by hand in parallel with the surface of monitor 11 along arrows142, 144 and 146 for example starting with the state of FIG. 6(B). Themovement is detected by acceleration sensor 40 to automatically scrollthe enlarged picture within monitor 11 toward the direction opposite tothe movement of digital camera 2 to cancel the movement thereof as shownin various positions 148, 150, 152 and 154 of monitor 11 and theenlarged pictures displayed therein, respectively. Thus, as shown inFIG. 6(C), monitor 11 moves to change the viewable area on the enlargedpicture, the absolute position of which substantially kept stationary.This means that wider area of the entire enlarged picture iscomprehensible by means of persistence of vision.

In more detail, the comprehension of the entire enlarged picture due tothe retention of brain and persistence of vision may become easier ifthe frequency of the repetitions of movement of digital camera 2 isincreased within the limit for the scroll speed to follow the movementof digital camera 2. However, some delay from the detection of themovement of digital camera 2 by acceleration sensor 40 to the scroll ofpicture on monitor 11 is caused by the time necessary for cameracontroller 21 to process data, which makes it incomplete to keep theabsolute position of the picture stationary. To improve the above,camera controller 21 carries out a prediction process on the basis ofthe detection by acceleration sensor 40 to direct an advanced scroll ofthe picture with the result of the prediction process incorporated. Theprediction process is especially advantageous to predict the turningpoints of movement on the base of the detection of the speed reductionof the movement. For the prediction process, memory 23 stores data ofaverage characteristic of human hand movement experimentally correctedfrom many persons.

FIG. 7 is a table showing a data format constructing the calendar image.The data constructing the calendar image is divided into three groupswhich can be treated independently from each others, the three groupsbeing layout data group 162, calendar data group 164 and picture datagroup 166. And, all data necessary to complete one calendar for a yearare connected with the same calendar ID stored in ID areas 168, 170 and172. Further, all data necessary to complete one calendar for a monthare connected with the same year and month designation stored in Y/Mdesignation areas 169, 171 and 173. Thus, the picture image is relatedto various attribute data to handle the picture image. By means of theabove data format, a calendar image of each month can be constructed andits layout and picture can be changed any time. Due to the change in thelayout or picture, a plurality of layout data groups or picture datagroups having the same ID and the same year/month designation may becaused. Each of such a plurality of layout data groups or picture datagroups are distinguished from the others by the time stamp stored intime stamp areas 174, 176 and 178 since the time stamp is of the timewhen a new data group is created and differs from others.

Layout data group 162 includes data area 180 storing data of layout forhorizontally long picture such as in FIG. 2 and data area 182 storingdata of layout for vertically long picture such as in FIG. 3. These dataarea 180 and 182 are to prepare for a substitution between the layoutfor horizontally long picture and the layout for vertically long pictureunder the same ID and the same year/month designation. For example, ifonly a new vertically long picture is substituted for the horizontallylong picture 62 in the calendar for October shown in FIG. 2, the layoutis automatically changed into the layout for vertically long picturesuch as in FIG. 3. In this case, however, year and month are unchangedsince the same calendar data group 164 carries on. Therefore, in the newlayout as in FIG. 3, calendar of October is shown at calendar 84 forthis month in the center of the calendar image. And, calendar ofSeptember is shown at calendar 86 for previous month on the left ofvertically long picture 82, while calendar of November is shown atcalendar 88 for following month on the right of vertically long picture82. Further, in contrast to FIG. 3, year indication 64 at the top ofelectronic paper monitor 6 is not accompanied with next year indication92 since the three months, i.e., September to November, do not crossover two years.

Calendar data group 164 includes data area 184 for storing data of year,month and days of week for three months including the month designatedby the data stored in year and month designation area 171 and a pair ofmonths previous and following the designated month. Calendar data group164 also includes data area 186 for storing national holidays by countryin the three months with respect to various registered countries.Further, calendar data group 164 includes data area 188 for fixed eventdata and data area 190 for free event data each for the three months.Calendar data group 164 still further includes data area 192 for storinghand-written image data gotten through touch panel 56, which is used toadd hand-written comment of character or mark to calendar imagedisplayed on electronic paper monitor 6, or is to be transmitted todigital camera 2 for conversion into a code data by OCR 58.

Picture data group 166 includes data area 194 for storing data ofpicture image taken and selected by digital camera 2 and data area 196for storing data indicating whether the picture is of horizontally longor vertically long. Calendar data group 164 also includes data area 186for storing national holidays by country in the three months withrespect to various registered countries. Further, picture data group 166includes data are 198 for storing the image size of the picture storedin area 194 and data area 200 for storing data of electronic papermonitor information which is to be transmitted to digital camera 2 forinforming of the size of electronic paper monitor 6. As in the datastored in areas 192 and 200, data for constructing the calendar imageinclude data area for storing data to be transmitted from electronicpaper display 4 to digital camera as well as data to be transmitted fromdigital camera to electronic paper display 4. Thus, the data format inFIG. 7 is used for bidirectional data transmission.

FIG. 8 is a flowchart showing the function carried out by cameracontroller 21 of the first embodiment in FIG. 1. The flowchart startswhen a power switch of digital camera 2 is made on at operating portion13. If the flow starts, start-up and display information managementprocess is carried out in step S2. The process in step S2 is forbeginning various functions of digital camera 2 with initial statesthereof, respectively, and for checking whether or not information ofthe size of electronic paper monitor 6 has been received from electronicpaper display 4 and stored in calendar creation data storage 36. Theprocess is step S2 also includes a function of automatically indicatinga message on monitor 11 for a predetermined time to inform the user ofthe necessity for digital camera 2 to get the information though cameraI/O 16 if the size of electronic paper monitor 6 has not been stored incalendar creation data storage 36.

In the following step S4, digital camera 2 is automatically set to startwith picture taking mode to go to step S4 for checking whether or notthe picture taking operation by the shutter release button in operatingportion 13. If the picture taking operation is detected in step S6, theflow goes to step S8 to carry out picture taking and storing process.Upon completion of the process in step S8, the flow advances to step S10to start displaying the taken picture on monitor 11 to go to step S12for checking whether or not a predetermined time lapses after the startof the taken picture display. If not, the flow goes to step S14 to checkwhether or not the operation is made at operation portion 13 for markingthat the picture is specially taken for the purpose of possibly creatinga calendar or inspired by the taken picture on display to possibly useit in creating a calendar. If not, the flow goes back to step S12 torepeat steps S12 and S14 in waiting for the marking operation. On theother hand, if it is detected in step S14 that the marking operation ismade, the flow advances to step S16 to attach the calendar mark to thestored image data of the taken picture, the flow then going to step S18to terminate the display of the taken picture in advance to go to stepS20. On the other hand, if the time lapse is detected in step S12without marking operation within the predetermined time, the flowdirectly goes to step S18 to terminate the display of the taken picture,the flow then going to step S20.

In step S20, it is checked whether or not a setting operation is made tochange the picture taking mode to play mode for retrieving the storedimage data and display the taken picture on the retrieved image data. Ifthe play mode setting operation is detected in step S20, the flowadvancing to step S22 to start the play mode to go to step S24. In stepS24, it is checked whether or not the marking operation is made atoperation portion 13 to mark the played picture for possible use increating a calendar. If the marking operation is detected in step S24the flow advances to step S26 to attach the calendar mark to the imagedata corresponding to the picture played on monitor 11, the flow thengoing to step S28. On the other hand, if the marking operation is notdetected in step S24 the flow directly goes to step S28.

In step S28, it is checked whether or not a setting operation is made tochange the play mode to the picture taking mode. If the picture takingmode setting operation is detected in step S28, the flow advances tostep S30. On the other hand, if the picture taking mode settingoperation is not detected in step S28, the flow goes back to step S24 torepeat steps S24 to S28 for continuing the play mode unless the picturetaking mode operation is detected in step S28. Though steps are omittedin FIG. 8, conventional functions in play mode such as displaying ofthumbnails and feeding of picture to picture are possible during therepetition of steps S24 to S28. By the way, if the play mode settingoperation is not detected in step S20, the flow directly goes to stepS30.

In step S30, it is checked whether or not the calendar operation tostart creating a calendar is made. If the calendar operation is detectedin step S30, the flow goes to step S32 in which calendar creation iscarried out. The details of calendar creation process in step S32 willbe mentioned later. If the calendar creation process is over, the flowgoes to step S34. Further, if the calendar operation is not detected instep S30, the flow directly goes to step S34. In step S34, it is checkedwhether or not power off operation is made at operating portion 13 to goto the end if the power-off operation is detected. On the other hand, ifthe power-off operation is not detected, the flow goes back to step S6to repeat steps S6 to S34 to cope with the change between picture takingmode and play mode as well as the preparation and creation of calendarunless the power off operation is detected.

FIG. 9 is a flowchart showing the detailed function of the calendarcreation process in step S32 in FIG. 8. If the flowchart starts, it ischecked in step S42 whether or not any calendar has already beenregistered. If any, the flow goes to step S44 to display list of all theregistered calendars on monitor 11. Next, in step S46, it is checkedwhether or not one of the registered calendar is selected among the listwithin a predetermined period of time. If not, the flow goes to step S48to display list of calendar layouts on monitor 11. Further, if noregistered calendar is detected in step S42, the flow directly goes tostep S48. With the new layout lists displayed, the flow advances to stepS50 to check whether or not one of the new calendar layouts is selectedamong the list within a predetermined period of time. If the selectionis detected, the flow goes from step S50 to step S52 to adopt theselected layout to go to step S54. On the other hand, if the selectionis not detected in step S50, the flow goes to step S56 to automaticallyadopt a predetermined default layout to go to step S54.

In step S54, calendar data of year/month/day for one year including thedate of operation for creating the calendar is automatically prepared inaccordance with the adopted layout. Next, in step S58, day of week andnational holidays are adjusted in accordance with the shift or changecaused depending on the year. In step S58, the event data, which havebeen input and capable of being carried on the new calendar, are alsoadjusted in accordance with the new calendar. In step S58, the adjustedday of week, holidays and event data are related to corresponding daysof the new calendar. The process in step S58 will be discussed later inmore detail. The process in step S58 is followed by step S60 fordisplaying the completed calendar for the designated month on monitor11.

On the other hand, if it is determined in step S46 that one of theregistered calendars is selected among the list within a predeterminedperiod of time, the flow goes to step S62 to check whether or not thecalendar operation in step S30 was made for creating a new calendar.This check is carried out by means of indicating a corresponding queryon monitor 11 for requesting the answer to be manually input byoperating portion 13. If the answer informing of a new calendarcreation, the flow goes from step S62 to step S54 to carryout thecalendar creation in the similar manner to that of the calendar creationwith the new layout adopted. In other words, if step S54 follows stepS62, a calendar is created with only the registered layout diverted as atemplate and all the calendar contents newly prepared and applied to thediverted layout.

In contrast to the above, if it is determined in step S62 that thecalendar operation in step S30 was not made for creating a new calendar.This means that the calendar operation in step S30 was made forpartially modify or correct an existing calendar. The flow in this caseaccordingly goes form step S62 to step S64 to carry out a process ofselecting a month as a target of the modification or correction.According to the process in step S64, manual selection at operationportion 13 is requested to designate the month if the modification orcorrection relates to a specific month such as in the case ofsubstitution of the picture or change or addition of event data. On theother hand, the month is do selected automatically to include the dataof operation if the modification or correction is common to months suchas in the case of calendar layout. Step 64 is followed by step S60 todisplay the selected or designated month.

In step S66, it is checked whether or not the picture input to fill thecalendar layout is selected by operating portion 13 as an input itemamong input menu. If the picture input is selected, the flow goes tostep S68 to prepare both the calendar layout for horizontally longpicture and the calendar layout for vertically long picture bothbelonging to the same calendar layout identified by the same ID selectedto be filled by the picture. And, the flow goes to step S70 to carry outpicture input and calendar layout process, the flow then going to stepS72. The process in step S70 will be discussed later in more detail. Onthe other hand, if it is determined in step S66 that the picture inputis not selected by operating portion 13, the flow directly goes to stepS72.

In step S72, it is checked whether or not new input operation relatingto event data is made at operating portion 13. If the new inputoperation relating to event data is made, the flow goes to step S74 toadd new event data, or to alter or delete existing event data inaccordance with the detailed operation at operating portion 13, the flowthen going to step S76. On the other hand, if it is determined in stepS72 that no new input operation relating to event data is made atoperating portion 13, the flow directly goes to step S76.

In step S76, it is checked whether or not the operation to continue thecalendar creation with new month designated is made within apredetermined time after the final operation for the preceding calendarcreation for another month. If such an operation is detected in stepS76, the flow goes back to step S58 to repeat steps from S58, S60 andS66 to S76 every time when new month designation is effectively made. Onthe other hand, if it is determined in step S76 that no operation isdetected after the previous final operation within the predeterminedtime, the flow goes to step S78 to register the inputs which have beendone through the previous steps and to make administration of datainput/output, the flow then goes to the end. The process in step S78will be discussed later in more detail.

FIG. 10 is a flowchart showing the detailed function of the day ofweek/holiday/event data adjustment process of step S58 in FIG. 8. If theflow starts, the year is checked in step S82 and the month is checked instep S84 to confirm year and month of the calendar for one month. Withrespect to the calendar for one month confirmed above, day of week isadjusted in step S86, and the font style of the days corresponding toSunday are modified in step S88 into bold for example. Further, in stepS90, the country data is checked to confirm country where the calendaris used. On the basis of the confirmed country, the font style of thedays corresponding to national holidays of the country are modified instep S92 to be encircled for example. According to the functions above,image data of calendars for many years can be created with the shift orchange in day of week and national holidays taken into considerationwithout individually storing image data of year calendar itself for manyyears.

Next in step S94, it is checked whether or not past free event data isconnected to the calendar utilizing in creating the new calendar. Thisstep is to cope with such a case that step S58 is carried out by way ofstep S62 for creating new calendar with registered calendar layoututilized. If it is determined in step S94 that past free event data isconnected to the registered calendar to be utilized, the flow goes tostep S96 to exclude the corresponding event data from the registeredcalendar, the flow then going to step S98. It should be noted that theexclusion of free event data in step S96 does not mean a completedeletion thereof, but a cancellation of relationship between theregistered calendar to be utilized and the past free event data whichhad been connected with the same ID. On the other hand, if it is notdetermined in step S94 that past free event data is attached to theregistered calendar to be utilized, the flow directly goes to step S98.

In step S98, it is checked whether or not any event data is input andstored. If any, the flow goes to step S100 to check whether or not fixedevent data is included in the event data storage. If a fixed event datais detected in step S100, the flow goes to step S102 to retrieve thefixed event data to go to step S104. On the other hand, if no fixedevent data is detected in step S100, the flow directly goes to stepS104. Thus, fixed event data such as the birthday can be automaticallycarried on every calendar year once the fixed event data in input andstored.

In step S104, it is checked whether or not free event data is includedin the event data storage picked up in step S98. If a free event data isdetected in step S104, the flow goes to step S106 to check whether ornot the free event data is for future event within coming twelve months.If any, the flow goes to step S108 to retrieve the free event data to goto step S110. On the other hand, if no free event data is detected instep S104, the flow directly goes to step S110. Further, if it isdetermined in step S106 that the free event data is not for future eventwithin coming twelve months, the flow directly goes to step S110. Thus,free event data once input and stored can also be automatically carriedon new calendar if the free event data is for future event and the dateof the event is within coming twelve months for avoiding a mistake forwrong year. In step A110, the event data retrieved in step S102 and/orstep S108 are attached to the new calendar by means of connection by thesame ID, the flow then going to the end.

FIG. 11 is a flowchart showing the detailed function of the pictureinput and calendar layout process in step S70. If the flow starts, instep S122, thumbnails marked for use in calendar creation are picked upand retrieved for viewing on monitor 11. In this respect, all theretrieved thumbnails can be viewed on monitor 11 by scrolling the windowif the number of retrieved thumbnails exceeds the limit capable of beingdisplayed on monitor 11 at once although detailed steps for such afunction are omitted in FIG. 11. With the thumbnails displayed onmonitor 11, the flow goes to step S124 to check whether or not otherpicture requesting operation is made at operating portion 13, such anoperation being possibly made when other picture is requested to viewsince no suitable picture for calendar is found among the markedthumbnails. If the operation is detected in step s124, the flow goes tostep S126 to start play mode.

Then, the flow goes to step S128 to check whether or not the operationis made at operation portion 13 for marking that the picture is possiblyused in creating a calendar. The marking is similar to the marking madein step S14 except for the marking timing. If it is detected in stepS128 that the marking operation is made, the flow advances to step S130to attach the calendar mark to the stored image data, the flow thengoing to step S132. On the other hand, if no marking operation isdetected in step S128, the flow directly goes to step S132. In stepS132, it is checked whether or not an operation is made at operatingportion 13 to inform that the marking operation is ended. If the markingending operation is not detected in step S132, the flow goes back tostep S128 to continue marking operation by repeating steps S128 to S132unless the marking ending operation is made.

On the other hand, if the marking ending operation is detected in stepS132, the flow goes to step S134 to retrieve thumbnails newly markedthrough steps 128 to S132 for use in calendar creation for viewing onmonitor 11. Next in step S136, it is checked whether or not pictureselection among displayed thumbnails is made within a predeterminedperiod of time after the latest operation. By the way, if it isdetermined in step S124 that other picture requesting operation is notmade at operating portion 13, the flow directly goes to step S136 towait for selection with the thumbnails retrieved in step S122 displayed.

If no picture selecting operation over the predetermined period or timeis decided in step S136, the flow goes back to step S122. This makes itpossible to search again into thumbnails firstly retrieved in step 122in case that other picture is considered through steps S124 to S134.Further, the flow begun with step S122 again makes it possible to reviewagain the other picture by reconsider the marking. In the above manner,steps S122 to S136 are repeated to continue the collection and review ofpossibly usable pictures for calendar creation unless picture selectionis detected in step S136.

On the other hand, if picture selecting operation is detected within thepredetermined period or time in step S136, the flow goes back to stepS137 to display the picture corresponding to the selected thumbnail asin the manner shown in FIG. 5(A). Next in step S138, it is checkedwhether or not the selected picture is horizontally long. In the case ofthe horizontally long picture, the flow goes to step S140 to adopt thecalendar layout for horizontally long picture from the two types oflayout prepared in step S68 in FIG. 9, the flow then going to step S142.On the other hand, if it is determined in step S138 that the selectedpicture is not horizontally long, the flow goes to step S144 to adoptthe calendar layout for vertically long picture from the prepared twotypes of layout, the flow then also going to step S142. The adoption ofthe calendar layout of horizontally/vertically long picture is necessaryfor the next step S142 to determine the automatic enlarging ratio whichdiffers depending on the layout type.

In step S142, enlarge/scroll process is carried out. This processcorresponds to the explanation in conjugation with FIG. 5 and FIG. 6.The process in step S142 will be further explained in more detail. Uponcompletion of the enlarge/scroll process in step S142, the flow goes tostep S146 to check whether or not entering operation for finalizing theinput of picture is made at operating portion 13 within a period of timeafter the preceding operation. If no such an operation is detected instep S146 over the predetermined period of time, the flow goes back tostep S136 to repeat steps S136 to step S146 unless the enteringoperation is made. In response to the return to step S136, the displayon monitor 11 is reset to the condition of viewing the retrievedthumbnails, which makes it possible to make a selection of anotherpicture. Further, if no picture selection over the predetermined periodof time is determined in step S136 in this case, the flow further goesback to step S122, which makes it possible to make the marking operationagain for widening the options for picture selection.

On the other hand, if the entering operation is detected within thepredetermined period or time in step S146, the flow goes to step S148 tocheck whether or not the adopted calendar layout includes the formerpicture attached to the calendar layout. The existence of the formerpicture to be detected in step S148 means that the selection of thepicture this time corresponds to a mere substitution of the picture inan already completed calendar. Thus, if the former picture is detectedin step S148, the flow toes to step S150 to check whether or not thenewly entered picture is of the same type of the horizontally longpicture and the vertically long picture as that of the former picture.If not, the flow goes to step S152 to switch between the calendar layoutfor horizontally long picture and the calendar layout for verticallylong picture, the flow then going to step S154. For example, if theformer calendar layout is of the type of FIG. 2 and the new picture isvertically long, the calendar layout is automatically switched to thetype of FIG. 3. On the other hand, if it is determined in step S150 thatthe new and former pictures are of the dame type, the flow directly goesto step S154, in which the substitution of the picture is to be simplymade with the former calendar layout carried on. On the other hand, noformer picture is detected in step S148, the flow goes to step S156 touse the newly and suitably adopted calendar layout, the flow then goingto step S156. In step S154, the picture is finally entered into thesuitable calendar layout to go to the end of the flow.

FIG. 12 is a flowchart showing the detailed function of theenlarge/scroll process in step S142 in FIG. 11. If the flow starts, itis checked n step S162 whether or not touch panel 38 sense a touchwithin a predetermined period of time. If any, the flow goes to step 164to carry out sensed position determining process. And, in step S166, thefirst time is directed to start to count the first predetermined time togo to step S168, in which it is checked whether or not information ofthe size of electronic paper monitor 6 is stored in calendar creationdata storage 36. If the size information is stored, the flow goes tostep S172 to retrieve the stored size information to go to step S172. Onthe other hand, it is not determined in step S168 that size informationof electronic paper monitor 6 is stored in calendar creation datastorage 36, the flow goes to step S174 to retrieve predetermined defaultsize information of a standard display monitor prepared in calendarcreation data storage to go to step S172. It should be noted that stepS174 is not to realize an enlargement of image on monitor 11 with theactual size of the picture to be displayed on electronic paper monitor6, but to prefer the advancement of the flow with some image sizeinformation to a freezing of the flow for seeking size information ofelectronic paper monitor 6.

In step S172, it is checked whether or not the displayed picture ishorizontally long. In the case of horizontally long picture, the flowgoes to step S176 to get the size of horizontally long image to bedisplayed on electronic paper monitor 6 in accordance with the calendarlayout for horizontally long picture to go to step S178. On the otherhand, if it is not determined in step S172 that the displayed picture ishorizontally long, it means that the picture is vertically long. In thiscase, the flow goes from step S172 to step S180 to get the size ofvertically long image to be displayed on electronic paper monitor 6 inaccordance with the calendar layout for vertically long picture to go tostep S178. The size of horizontally or vertically long picture above isgotten by the size of electronic paper monitor 6 and the calendar layoutfor horizontally or vertically long picture.

In step S178, the scale of enlargement for displaying the picture onmonitor 11 with the actual size just the same as that of the picture tobe displayed on electronic paper monitor 6 is calculated on the basis ofthe size of horizontally or vertically long picture to be displayed onelectronic paper monitor 6 according to the calendar layout gotten instep S176 or step S180 and the image size of the picture taken. As hasbeen pointed out above, in the case that step S172 follows step S174,the scale of enlargement for actual size on monitor 6 is not calculatedin step S178, but a scale of enlargement in calculated on the basis ofthe default size information. Next in step S182, the coordinate of thetouched point determined in sensed position determining process in stepS164 is gotten to go to step S184, in which the trimming enlargement tothe real display size on electronic paper monitor 6 around the touchpoint is realized. Thus, the display in FIG. 5(A) is change to thedisplay in FIG. 5(B) in response to the touch on electronic papermonitor 6 provided with touch panel 56.

The succeeding steps S186 to S194 relate to the function of scrollingthe picture enlarged with trimming in step S184 according to the manneras in FIG. 6(C). Firstly in step S186, it is checked whether or notacceleration sensor 40 detects acceleration over a predeterminedthreshold. If the acceleration is detected, the flow goes to step S188for carrying out acceleration predicting process for predict futureacceleration on the basis of the change in acceleration actuallydetection by acceleration sensor 40. As has been already mentioned, theprediction process is especially advantageous to predict the turningpoints of movement on the base of the detection of the speed reductionof the movement. Next in step S190, the scroll is carried out toward thedirection opposite to the movement of digital camera 2 to cancel themovement thereof on the basis of the acceleration actually detection byacceleration sensor 40 and the prediction by the function in step S188.Further, in step S192, the first time is reset and restarted to go tostep S194. On the other hand, if no acceleration over the threshold isdetected in step S186, the flow directly goes to step S194.

In step S194, it is checked whether or not the first timer has countedup the first limit time. If not, the flow goes back to step S186 torepeat steps S186 to 194 to continue the scroll operation unless thefirst timer does not count up the first limit time. Since the firsttimer is reset and restarted in step S192 every time when newacceleration is detected in step 186, the scrolling function by means ofthe repetition of steps S186 to S194 continues as long as digital camera2 is being moved. On the other hand, if it is detected in step S194 thatthe first timer has counted up the first limit time, the flow goes tostep S196 the trimming enlargement to return the display as in FIG.6(A). And, in succeeding step S198 the second time is started, the flowthen going to the end. By the way, if it is not determined in Step S162that touch panel 38 senses a touch within a predetermined period oftime, the flow directly goes to step S198. The second limit time countedby the second timer started in step S198 corresponds to the period oftime in the check in step S146 in FIG. 11 within which it is checkedwhether or not the entering operation is made. In other words, thedisplay as in FIG. 6(A) continues during the period of time for waitingfor the entering operation in accordance with the function of step S146in FIG. 11.

FIG. 13 is a flowchart showing the detailed function of the inputregistering process and the data input/output administrating processboth carried out in step S78 in FIG. 9. If the flow starts, it ischecked in step S202 whether or not the inputs which have been donethrough the previous steps are for modify or correct an existingcalendar already registered with an ID. If the inputs are for an alreadyregistered calendar, the flow goes to step S204 to attach new time stampto the registered data group of the identified month to go to step S206.On the other hand, if it is determined in step S202 that the inputs arenot for an already registered calendar, the flow directly goes to stepS206.

In step S206, it is checked whether or not the inputs which have beendone through the previous steps are for newly created data group. Ifinputs for newly created data group, the flow goes to step S208 toattach new ID and new time stamp to the newly created layout data group.Similarly, new ID and new time stamp are attached to the newly createdcalendar data group in step S210. New ID and new time stamp are alsoattached to the newly created picture data group in step S212. Further,in step S214, new month designation is attached to each data group, theflow then going to step S216.

In step S216, image composition and administration process is carriedout. In other words, the process in step S216 includes decision onnecessity of image composition and execution of the image composition ifnecessary. The process in step S216 also includes administration of eachdata group incorporated into the image composition and of the completedimage composition data which has been transmitted to outside device. Thedetails of the image composition and administration process will befurther explained later. On the other hand, if it is not determined instep S206 that inputs which have been done through the previous stepsare for newly created data group, the flow directly goes to step S216.

The succeeding steps led by step S218 relate to administration ofinformation exchange with outside devices. The outside device includesnot only sophisticated ones such as electronic paper display 4 in FIG. 1which are capable of composing a calendar image by itself on the basisof a plurality of divided data groups, but also simplified ones such asdigital photo frames or digital printers capable of simply outputtingdisplay image or print on the basis of data transmitted in the form ofcompleted image.

Firstly in step S218, it is checked whether or not any informationexchange with an outside device is carried out through camera I/O 16. Ifany, the flow goes to step S220 to confirm ID of the outside device incommunication on the basis of received data from the outside device.And, in step S222, it is checked whether or not the device ID is newlyreceived from the outside device for the first time. In the case of newID, the flow goes to step S224 to newly store the received ID and sizeof display monitor of the outside device into calendar creation datastorage 36, the flow then going to step S226. On the other hand, if itis not determined that the device ID is newly received from the outsidedevice for the first time, the flow directly goes to step S226 since thedevice ID and size of display monitor of the outside device have beenalready stored in calendar creation data storage 36.

In step S226, it is checked whether or not the outside device is of thesophisticated type capable of composing a calendar image by itself onthe basis of a plurality of divided data groups. If not, the flow goesto step S228 to output complete calendar data created inside digitalcamera 2, the flow then going to step S230. On the other hand, if it isconfirmed in step S226 that the outside device is of the sophisticatedtype capable of composing a calendar image by itself, the flow goes tostep S232 to output only new data group necessary for newly composing orpartially modifying the calendar, the flow then going to step S230. Inthe case of creating an entirely new calendar, all the data groups as inFIG. 7 are output in step S232 for composition within the outsidedevice.

In step S230, it is checked whether or not image data gotten by touchpanel of the outside device is received. A typical example of such imagedata is the hand-written character or mark to indicate an event oncalendar sensed at touch panel 56 of electronic paper display 4 inFIG. 1. If it is detected in step S230 that any touch panel data atoutput device is received, the plow goes to step S234 to carryoutimage-code transformation process, in which the received image ofcharacter or mark is identified by OCR 53 functionally included cameracontroller 21 to transform it into code data indicative of the characteror mark. The process in step S234 further include a function to inputthe code data as an event data to be added to calendar data group, theflow then going to the end. In the process in step S234, coordinatesdata at which the hand-writing is made on touch panel 56 received alongwith the hand-written image itself is utilized to identify the date oncalendar where the event data is input. On the other hand, if it is notdetected in step S230 that any touch panel data is received, the flowdirectly goes to the end. If it is not detected in step S218 that anyinformation exchange with an outside device is carried out, the flowalso directly goes to the end.

FIG. 14 is a flowchart showing the detailed function of the imagecomposition/Administration process in step S216 in FIG. 13. If the flowstarts, it is checked in step S242 whether or not device ID of outsidedevice, to which the data for calendar is transmitted, has been gotten.If the device ID of outside device has been gotten, the flow goes tostep S244 to check whether or not the attribute of outside deviceidentified by the device ID shows that the outside device is of a typecapable of composing a calendar image by itself on the basis of aplurality of divided data groups. If it is determined in step S244 thatthe outside device is not of the type capable of composing a calendarimage by itself, the flow goes to step S246. If it is determined in stepS242 that ID of outside device has not been gotten yet, the flow alsogoes to step S246. Thus, steps led by steps S246 are prepared for copingwith the above cases that the outside device is possibly of thesimplified type capable of only outputting display image or print on thebasis of transmitted image data which has to have been completed on theside of digital camera 2.

In step S246, all data groups with the same calendar ID and the sameyear/month designation are retrieved to constitute a calendar of onemonth. In other words, a set of one layout data group, one calendar datagroup and one picture data group for a specific one month are retrieved.In doing so, if a plurality of the same type of groups, e.g., aplurality of picture data groups, with the same calendar ID and the sameyear/month designation exist, only one data group with the newest timestamp is selected among them as the type of data group, e.g., thepicture data group. Next in step S248, a calendar image for a monthcorresponding to the designated year and month is composed on the basisof the set of the retrieved data groups with selection made ifnecessary, the composed image data is kept for transmission to theoutside device. In step S250, a composition ID and the time stampshowing the composition time are attached to the calendar image composedin step S248. Further, in step S252, it is directed to also keep each ofthe original data groups consisting of the composed image data for thepurpose of at least a part of them in the possible future modificationof the composed image, which is to be newly composed on the basis ofunchanged group data and substituted group data, the flow then going tostep S254. On the other hand, if it is decided in step S244 that theoutside device is of the type capable of composing a calendar image byitself, the flow directly goes to step S246 since there is no necessityfor digital camera 2 to compose the calendar image.

In step S254, it is checked whether or not such a composed calendarimage data exists that has been actually transmitted to the outsidedevice identified by device ID without fail. If any, the composedcalendar image data is deleted in step S256 to go to the end of theflow. This means that the calendar image data, which was composed indigital camera 2 for transmission to the target outside device, is to bedeleted if it served the purpose. Even if the composed data is deleted,the reconstruction thereof on necessity is possible since the originaldata groups are kept according to the direction in step S252. On thecontrary, if it is determined in step S254 that no such a composedcalendar image data exists that has been actually transmitted to theoutside device identified by device ID, the flow instantly goes to theend of the flow.

FIG. 15 is a flowchart showing the function carried out by displaycontroller 52 in electronic paper display 4 of the first embodiment inFIG. 1. The flowchart starts in response to an operation to initiatecommunication with digital camera 2 by way of display I/O 22 such asinsertion of removable card storage 20 into card slot 24, or insertionof a cable into cable I/O 30, or a manual operation to initiate wirelesscommunication by wireless I/O 32. The flowchart also starts in responseto a hand-writing input at touch panel 56 or at the beginning of thenext month on the basis of clock 54. The above mentioned operation toinitiate communication with digital camera 2 is mainly for transmit datafrom digital camera 2 to electronic paper display 4. However, theflowchart starts in response to any purpose of operation to startcommunication including the data transmission from electronic paperdisplay 4 to digital camera 2. For facilitating the above mentionedstart of the flowchart, electronic paper display 4 in power-save mode isin standby state capable of responding to various types of abovementioned trigger to start the flowchart.

If the flow starts, electronic paper display 4 is switched from thepower-save mode to active mode in step S262. And, in step S264, it isdirected to read clock data to go to step S266. In step S266, it ischecked whether or not the flow has been started in response to datainput caused by the initiation of communication with digital camera 2.If it is determined in step S266 that the flow has been started inresponse to data input, the flow goes to step S268 to store the inputdata which has started the flowchart. In the succeeding step S270, it ischecked whether or not the data relates to this month. If not, the flowgoes to step S272. If it is not determined in step S266 that the flowhas been started in response to data input caused by the initiation ofcommunication with digital camera 2, the flow also goes to step S272.

In step S272, it is checked whether or not the flow has been started atthe beginning of the next month on the basis of clock 54. In the case offlow starting at the beginning of the next month, the flow goes to stepS274 to check whether or not data of this month is stored. If any, theflow goes to step S276. If it is determined in step S270 that the storeddata relates to this month, the flow also goes to step S276. In stepS276, it is checked whether or not the stored data relating to thismonth is a composed calendar data. If not, the flow goes to steps led bystep S278 to compose a calendar in electronic paper display 4 by itself.

In step S278, the set of layout data group, calendar data group andpicture data group with the same calendar ID and the designation of thismonth are retrieved. It should be noted that the retrieved set of datagroups are former ones, i.e. the original data groups of the currentlydisplayed calendar image before modification, or of the calendar imageof the last month at the beginning of the new month. In the succeedingstep S280, the new group data is substituted for the corresponding oneof the retrieved set of data groups. The new data group above means thenewly input data stored in step S268 in the case of modification of thecurrently displayed calendar. Or, the new data group above means thedata for this month which is confirmed in step S274 to be stored in thecase of calendar change at the beginning of new month. In step S282, thenew calendar image is composed on the set of data groups with thesubstitution made.

On the other hand, if it is determined in step S274 that data of thismonth is not stored at the beginning of the new month detected in thepreceding step, the flow goes to step S284 to check whether or not thecalendar of last month is still on display. If last month on display,the flow goes to step S286 to check whether or not the calendar now ondisplay has been composed outside and received. If not, it means thatthe calendar image now on display has been composed within electronicpaper display 4 which keeps original data groups constituting thecalendar, the kept original data groups being utilizable in electronicpaper display 4 to modify the last month calendar into the new monthcalendar. Thus, the flow goes from step S286 to step S288 to substitutenew calendar data group for last month calendar data group with layoutdata group and picture data group taken over, the flow then going tostep S282 to compose the new calendar image.

In step S290, which follows step S282, image memory update process iscarried out to update the image data in image memory 48 with the newlycomposed calendar image data to change the calendar display onelectronic paper monitor 6. By the way, if it is determined in step S284that the calendar of last month is not displayed, the flow goes to stepS292. If it is determined in step S286 that the calendar now on displayhas been composed outside and received, the flow also goes to step S292.Since electronic paper display 4 by itself cannot compose the calendarimage date in both cases above, step S292 is prepared to retrieve apredetermined standard new calendar image including a prepared standardpicture, the flow then going to step S290. If it is determined in stepS276 that the stored data relating to this month is a composed calendardata, the flow directly goes to step S290 since there is no need ofcomposing a calendar in electronic paper display 4.

In step S294, which follows step S290, output administration process iscarried out for facilitating information transmission from electronicpaper display 4 to digital camera 2, the details of which will beexplained later. By the way, if it is determined in step S272 that theflow has not been started at the beginning of the next month, the flowdirectly goes to step S294. In step S296, which follows step S294,electronic paper display 4 is set to a standby state for responding tovarious types of above mentioned trigger to start the flowchart in FIG.15. Further in step S298, electronic paper display 4 is switched fromthe active mode to the power-save mode, the flow is then ended.

FIG. 16 is a flowchart showing the detailed function of the outputadministration process in step S294 in FIG. 15. If the flow starts, itis checked in step S302 whether or not touch panel 56 senses any touchthereto. If any, the flow advances to step S304 to carry out touch panelinput process to input hand-written character or mark by tracing thechange in the touched point on touch panel 56. Next in step S306, theinput hand-written character or mark is superimposed on calendar imageon electronic paper monitor 6. Thus, character or mark can behand-written on the calendar image as if it is written on a real paper.Further, image data of the input hand-written character or mark isstored in step S308, and coordinates of hand-written character of markon touch Panel are stored in step S310, the flow then going to stepS312. On the other hand, if no touch is sensed in step S302, the flowdirectly goes to step S312.

In step S312, it is checked whether or not electronic paper display 4 isin a condition capable of communicating with digital camera 2 inresponse to the operation to initiate communication with digital camera2 by way of display I/O 22 such as insertion of removable card storage20 into card slot 24, or insertion of a cable into cable I/O 30, or amanual operation to initiate wireless communication by wireless I/O 32.If the communication is capable, the flow goes from step S312 to stepS314 to check whether or not the hand-written touch panel input data isstored. If the touch panel data is stored, the flow goes from step S314to step S316 to check whether or not the stored hand-written touch panelinput data has been already transmitted to digital camera 2. If not, theflow goes from step S316 to step S318 to output the stored hand-writtentouch panel input data for transmission. The fact of transmission of thehand-written touch panel input data is recorded in the succeeding stepS320, the flow then going to step S322. On the other hand, if it is notconfirmed in step S314 that the hand-written touch panel input data isstored, the flow directly goes to step S322. Further, if it is confirmedin step S316 that the stored hand-written touch panel input data hasbeen already transmitted to digital camera 2, the flow directly goes tostep S322.

In step S322, it is checked whether or not the size of electronic papermonitor 6 has been output for transmission to digital camera 2. If not,the flow goes to step S324 to output the monitor size data of electronicpaper monitor 6. The fact of transmission of the monitor size data isrecorded in the succeeding step S326, the flow then going to the end. Onthe other hand, if it is confirmed in step S322 that the monitor sizedata has been already transmitted to digital camera 2, the flow directlygoes to the end.

The flows in FIG. 15 and FIG. 16 are explained as the function ofelectronic paper display 4. However, the explained functions and theadvantages thereof are not limited to the electronic paper type display,but are widely applicable to other various types of display devices,such as liquid crystal display device or organic electroluminescencedisplay device. Further, the explained functions and the advantages areapplicable not only display devices, but also other various imagevisualizing device induding digital photo frame and digital printer.

The explained functions and the advantages according to this inventionare applicable not only the cooperation between a digital camera andelectronic paper display, but also other various combination betweenimage capture device and image visualizing device such as mobile phonewith camera incorporated and television set capable of receiving digitalstill image input.

Second Embodiment

FIG. 17 is a table showing a data format constructing the calendar imagefor a digital image enjoying system including an image output device andimage display device according to the second embodiment of thisinvention. The block diagram of the image output device and the imagedisplay device of the second embodiment are similar to those of thefirst embodiment in FIG. 1, which is diverted to the second embodimentwith detailed explanations skipped. The data format constructing thecalendar image of the second embodiment is also basically similar tothat in the first embodiment shown in FIG. 7. In more detail, layoutdata group 162 and calendar data group 164 in FIG. 7 for the firstembodiment are diverted as they are into the data format of secondembodiment, these two data group being accordingly not shown in FIG. 17with the explanation of them skipped. On the other hand, picture datagroup 166 is shown in FIG. 17(A) with a modification, other commonelements being shown in the similar numerals to those in FIG. 7 with theexplanation of them omitted.

The modification in the second embodiment shown in FIG. 17, which is thedifference from picture data group 116 in the first embodiment in FIG.7, is that picture data group 166 shown in FIG. 17(A) includes calendarslideshow subgroup 202 in place of year/month designation 173 in FIG. 7.FIG. 17(B) shows detailed format of calendar slideshow data subgroup202, which is to be displayed on monitor 11 of digital camera 2 inaccordance with a display layout similar to the form shown in FIG. 17(B)for GUI input operation and confirmation of the input contents.

Calendar slideshow subgroup 202 (hereinafter simply referred to as“subgroup 202”) includes shooting date and time area 204 into which theshooting data and time derived from click 33 in camera controller 21 areautomatically input in response to camera release operation. Subgroup202 also includes GPS information area 206 into which an identificationof a place such as name of the place where the picture is taken isautomatically input in accordance with GPS unit 25 in response to camerarelease operation. Subgroup 202 further includes key personidentification area 208 into which an identification of key person inthe picture such as name of the person is input, the key person beingtypically the main subject of the picture. The key person identificationis to be manually input upon taking the picture, or is to beautomatically input by means of a facial recognition system incorporatedin image processor 10 in response to camera release operation.

Holiday relating data area 210 in subgroup 202 is for manually inputsuch data as to show that the picture relates to specific one ofnational holidays corresponding to data stored in data area 186 incalendar data group 164 in FIG. 7. In more detail, one of or both ofdate identifying a national holiday and the name of the national holidayis manually input into holiday relating data area 210. The relationshipis not necessarily input based on fact, but can be done in an arbitrarymanner. In other words, even a picture not actually taken on a nationalholiday last year can be related to the same national holiday of thenext year if the picture is personally and arbitrary considered to suitthe national holiday. Therefore, if there is a discrepancy between thedate stored in shooting date and time area 204 and related nationalholiday in holiday relating data area 210, the latter is preferred.Further, if a picture was taken on a national holiday last year, thepicture is treated as related to the national holiday by input somethinge.g., even a meaningless mark, into holiday relating data area 210. Inother words, by means of input something into holiday relating data area210, all the national holidays stored in the area 186 in FIG. 7 aresearched whether or not one of them coincides with the date in shootingdate and time area 204 to treat the picture image in the area 194 ofpicture data group 166 to be related with the coinciding holyday.

Similarly, fixed event relating data area 212 and free event relatingdata 214 in subgroup 202 are for manually input such data as to showthat the picture relates to specific one of fixed events or free eventscorresponding to data stored in data areas 188 and 190 6 in calendardata group 164 in FIG. 7. In more detail, one of or both of dateidentifying an event and the contents of the event is manually inputinto area 212 and/or area 214. In the case or fixed event relating data212, the treatment of the data is similar to that in holiday relatingdata. In other words, the relationship is not necessarily input based onfact, but can be done in an arbitrary manner as in the case of holidayrelating data. In other words, even a picture not actually taken on thedate of fixed event last year can be related to the same fixed eventdata of the next year if the picture is personally and arbitraryconsidered suiting the fixed event. Therefore, if there is a discrepancybetween the date stored in shooting date and time area 204 and the dateof related fixed event data in area 212, the latter is preferred.Further, if a picture was taken on a fixed event date last year, thepicture is treated as related to the fixed event date by input somethinge.g., even a meaningless mark, into holiday relating data area 212. Inother words, by means of input something into fixed event relating dataarea 212, all the fixed event data stored in the area 188 in FIG. 7 aresearched whether or not one of them coincides with the date in shootingdate and time area 204 to treat the picture image in the area 194 ofpicture data group t166 to be related with the coinciding date of fixedevent.

On the other hand, in the case or free event relating data in area 214,it is hardly expected that a picture was taken on the same date lastyear as a date in the future on which a future free event is scheduledthough similar free event may be repeated in years on the same date bychance. Thus, the priority is given to avoiding confusion in treatingfree event relating data rather than to automatic estimation ofrelationship. In other words, the picture image in area 194 is relatedto a free event only if a free event is uniquely identified on the basisof the date or contents input in free event relating data area 214.

Condition for automation area 216 is for setting condition or criteriafor automatically establishing relationship between picture image in are194 with a calendar for incorporating the picture into the calendar incase that picture image in are 194 is not identified by a specific datesuch as national holiday, fixed event data and free event data. Theconditions capable of being set includes person 218, place 220, season222, month 224 and day of week 226 as shown in corresponding areas inFIG. 17. In the case of calendar slideshow data subgroup displayed inmonitor 11, check boxes 228 are located each adjacent to correspondingone of the condition areas. Thus, selection of the type of conditionscan be selected by putting a tick in any of the boxes through GUI incooperation with operating portion 13. The detailed contents ofcondition is to be each manually input into person are 218, place area220, season area 222, month area 224 and day of week area 226, which aredisplayed in monitor 11 as in FIG. 17(B).

FIG. 18 is a flowchart showing the function carried out by cameracontroller 21 of the second embodiment according to the data formatshown in FIG. 17. Most of the functions the flowchart in FIG. 18 for thesecond embodiment are similar to those in FIG. 8 for the firstembodiment, steps in FIG. 18 similar to those in FIG. 8 being eachindicated by the same step number with explanation omitted. FIG. 18differs from FIG. 8 in that steps S16 and S26 in FIG. 8 are replaced byslideshow calendar marking process in steps S332 and S334 each shown bybold faces and heavy lines. In other words, each of steps S332 and S3334in the second embodiment carries our calendar slideshow on the basis ofdata format in FIG. 17. The details of steps S332 and S334 will beexplained below.

FIG. 19 is a flowchart showing the detailed function of the slideshowcalendar marking process in steps S332 and S334 in FIG. 18. If the flowstarts, it is checked in step S342 whether or not the marking operationis made in step S14 or in step S24 for the purpose of using the picturein creating a calendar as in the first embodiment. If not, the flow goesto steps led by step S344 to carry out various inputs in accordance withthe data format shown in FIG. 17.

In step S344, an ID is attached to the picture to indicate that themarking operation is made for the purpose of using it in calendarslideshow. In other words, an ID indicating slide show use is input intoID area 172 of picture data group 166. Next in step S346, it is checkedwhether or not an operation is made to manually input identification ofkey person in picture. If any, the flow goes to step S348 to store theinput key person identification into area 208, the flow then going tostep S350. On the other hand, if no key person identification is input,the flow directly goes to step S350.

In step S350, it is checked whether or not an operation is made tomanually input holiday related data. If any, the flow goes to step S352to store the holiday related data into area 210, the flow then going tostep S354. On the other hand, if no holiday related data is input, theflow directly goes to step S354. In step S354, it is checked whether ornot an operation is made to manually input event related data. If any,the flow goes to step S356 to store the event related data into one orboth of fixed event relating data area 210 and free event related dataarea 214 according to the input made at step S356, the flow then goingto step S358. On the other hand, if no event related data is input, theflow directly goes to step S358.

In step S358, it is checked whether or not an operation is made to setany of conditions for automation by means of putting a tick in any ofthe boxes 228. If any, the flow goes to step S360 to store the settingof condition in condition for automation area 216, the flow then goingto the end of the flow. On the other hand, if no condition forautomation is set, the flow directly goes to the end. By the way, if itis determined in step S342 that the marking operation is made in stepS14 or in step S24 for the purpose of using the picture in creating acalendar as in the first embodiment, the flow goes to step S362 toattach the calendar mark to the stored image data of the taken pictureor played picture to go to the end of the flow. In this case the flow inFIG. 19, i.e., step S332 or step S334, functions in the same manner asstep S16 or step S16 or step S26.

FIG. 20 is a flowchart showing the function carried out by displaycontroller 52 of the second embodiment according to the data formatshown in FIG. 17. Most of the functions the flowchart in FIG. 20 for thesecond embodiment are similar to those in FIG. 15 for the firstembodiment, steps in FIG. 20 similar to those in FIG. 15 being eachindicated by the same step number with explanation omitted. As shown bybold faces and heavy lines, FIG. 20 differs from FIG. 15 in appearancein that steps S278 and S280 in FIG. 15 are combined into one step S364as “data group change process” However, the difference is just of amatter of expression in the drawing. In other words, the contents offunction in step S364 in FIG. 20 is identical with that in steps S278and S280 in FIG. 20. On the contrary, another difference from FIG. 15shown by bold faces and heavy lines in FIG. 20 is substantial. In otherwords, FIG. 20 substantially differs from FIG. 15 in that calendarslideshow process is step S366 is inserted between steps S282 and S290.The details of the calendar slideshow process will be explained later.

FIG. 21 is a flowchart showing the detailed function of the calendarslideshow process in steps S366 in FIG. 20. If the flow starts, it ischecked in step S372 whether or not any of picture data group 166including calendar slideshow subgroup 202 is left with its picture imagein area 194 unused. If any, the flow goes to step S374 to check whetheror not any of unused picture image is related to fixed event data. Ifnot, the flow goes to step S376 to check whether or not any of unusedpicture image is related to holiday data. If not, the flow further goesto step S378 to check whether or not any of unused picture image isrelated to free event data. If any, the flow goes to step S400 to checkwhether or not the date of the related free event data is in this month.If the free event is scheduled in this month, the flow goes to stepS402.

On the other hand, if it is determined in step S374 that any of unusedpicture image is related to fixed event data, the flow goes to step S404to check whether or not the date of the related fixed event data is inthis month. If the fixed event is scheduled in this month, the flow goesto step S402. On the contrary, if it is not determined in step S404 thatthe date of the related fixed event data is in this month, the flow goesto step S376. If it is determined in step S376 that any of unusedpicture image is related to holiday data, the flow goes to step S406 tocheck whether or not the date of the related holiday data is in thismonth. If the holiday is in this month, the flow goes to step S402. Onthe contrary, if it is not determined in step S406 that the date of therelated holiday data is in this month, the flow goes to step S378.

As in the above explanation, the series of functions in steps S374 toS400 are to set priority to the information in subgroup 202. In otherwords, the fixed event data is given top priority since the fixed eventdata is common to every year which is of high private interest in thehome to have possibly caused many interesting pictures in past years.The holiday data is given the second priority since the holidays arealso common to every year in which many interesting pictures in pastyears are also expected to have been caused though a national holiday isnot private event, but a public one. Thus, the free event data ischecked only when the unused picture image is not related to fixed eventdata or holiday data. By the way, if it is not determined in step S378that any of unused picture image is related to free event data, the flowgoes to step S408 to carry out automation process. If it is notdetermined in step S400 that the date of the related free event data isin this month, the flow also goes to step S408. The details ofautomation process in step S408 will be explained later.

In step S402, the picture data group 166 of the picture determined bythe previous steps as the slideshow picture is retrieved. In the nextstep S410, the picture data group corresponding to the currentlydisplayed picture in the regular calendar image of this month isreplaced by the retrieved picture data group. Next in step S412, newcalendar image data of this month is composed for slideshow on the basisof the data groups with the picture data group replaced. Further in stepS414, the newly composed calendar image data is given a mark indicativeof temporal intromission with term for administrating the temporalsubstitution of slideshow calendar image for the regular calendar imagewith the time limit for restoring the regular calendar image data. Thetime limit is set on the next day of the event or holiday to which thepicture is related. In the case that a specific day cannot be determinedfor the time limit as in the automation of slideshow explained later,the time limit is forcibly set at the end of the month or week, forexample. The replaced regular calendar image data is temporarily savedfor revival thereof in step S416, the flow then going to step S418.Thus, the new calendar image for calendar slideshow has been preparedfor use in step S290 in FIG. 20 to update the image data in image memory48 with the newly composed calendar image data to change the calendardisplay on electronic paper monitor 6. By the way, if it is determinedin step S372 that such a picture data group 166 is not left thatincludes calendar slideshow subgroup 202 with its picture image in area194 unused, the flow directly goes to step S418 without preparing anynew calendar image for calendar slideshow.

The functions carried out by the steps led by step S418 are to timelyrestore the regular calendar image data for replacing the expiredslideshow calendar image data by the regular calendar image data. Instep S418, it is checked whether or not the term of intromission of theslideshow calendar data expires. If the expiration is detected, the flowgoes from step S418 to step S420 to check whether or not the automationslideshow is active to prepare the next automation slideshow calendarimage data. If not, the flow goes to step S422 to retrieve the savedregular calendar image data of this month to go to the end of the flow.Thus, the gotten back regular calendar image has been prepared for usein step S290 in FIG. 20 to update the image data in image memory 48 withthe regular calendar image data to change the calendar display onelectronic paper monitor 6. On the other hand, if it is determined instep S420 that the automation slideshow is active to prepare the nextautomation slideshow calendar image data, the flow goes to step S424 toretrieve the next automation slideshow calendar image data to go to theend of flow. By the way, if it is not detected in step S418 that theterm of intromission of the slideshow calendar data expires, the flowinstantly goes to the end of the flow.

FIG. 22 is a flowchart showing the detailed function of the automationprocess in steps S408 in FIG. 21. If the flow starts, it is checked instep S432 whether or not any calendar image data for automationslideshow exists in unprepared condition. If any, the flow goes to stepS434 to check whether or not “month” is selected as a condition forautomation. If not, the flow goes to step S436 to check whether or not“season” is selected as a condition for automation. If “season” isselected, the flow goes to step S438. On the other hand, if it is notdetermined in step S434 that “month” is selected, the flow directly goesto step S438 regardless of the selection of “season”. Thus, with respectto the selection of condition for automation, “month”, which is moredetailed, prevails over “season”.

In step S438, all pictures which conform to the selected condition arepicked up. For example, if month or season is selected as the condition,all pictures with their shooting date and time in areas 204 falling intothe month or season specified in their month area 224 or season area 222are picked up. Next in step S440, the number of the picked up picturesis counted. Further in step S442 it is checked whether or not the sum ofintromission days assigned to each of the pictures exceeds the period ofspecified month or season. The intromission days means a term from theday of substitution of the automation slideshow calendar image for theregular calendar image to the day of restoring the regular calendarimage in place of the automation slideshow calendar image. If it isdetermined in step S442 that the sum of intromission days exceeds theperiod of specified month or season, the flow goes to step S444 toreduce the intromission days assigned to one picture by means of movingup each of the end of the intromission terms, respectively. This is fortrying to carry out the automation calendar slideshow by all of thepicked up pictures one by one within the specified month or season.

Further in step S446, it is checked whether or not the reduction causedthe number of intromission days per one picture less than one day. Thereduction to less than one day means that the number of the automationcalendar slideshow picture is superabundant even if the picture ischanged every day in the period of specified month or season. Thus, ifit is determined in step S446 that the reduction to less than one day iscaused, the flow goes to step S448 for randomly and repeatedly selectinga picture one by one form the picked up pictures to exclude the selectedpicture until the number of intromission days per one picture becomesequal or greater than one day, the flow then going to step S450. On theother hand, if it is not determined in step S442 that the sum ofintromission days exceeds the period of specified month or season, theflow directly goes to step S450. Further, if it is not determined instep S446 that the reduction caused the number of intromission days perone picture less than one day, the flow also directly goes to step S450.

In step S450, one picture is automatically and randomly selected amongeffective automation calendar slideshow pictures which have not beenplaced in the order of slideshow. Next in step S452, the selectedpicture is placed in the order of automation slideshow. Further in stepS454, it is checked whether or not any effective picture which has notbeen placed in the order of slideshow is left. If any, the flow goesback to step S450 to repeat the loop of steps S450 to S454 for randomlyselecting an effective picture one by one to place the selected picturein the order of the automation slideshow until all of the effectivepictures are placed in the order, which is detected in step S454 to goto step S456. By the way, if it is determined in step S432 that nocalendar image data for automation slideshow exists in unpreparedcondition, the flow directly goes to step S456. In step S456 it ischecked whether or not the day of next picture intromission comes. Ifthe day comes, the flow goes to step S458 to designate the picture oftop priority of the order to go to step S402 in FIG. 21.

On the other hand, if it is not determined in step S436 that “season” isselected, the flow goes to step S460 to check whether or not “person” isselected as a condition for automation. If the selection of “person” isdetermined in step S460, the flow goes to step S462 to check whether ornot the birthday of the designated person is in this month. If thebirthday of the person is in this month, the flow goes to step S438 withthe selection of “person” made valid as the condition. In this case, allthe pictures relating the person identified in area 208 in FIG. 17 arepicked up in step S438.

If it is not determined in step S460 that “person” is selected as acondition for automation, the flow goes to step S464. Further, if it isnot determined in step S462 that the birthday of the designated personis in this month, the flow also goes to step S464. In step S464, it ischecked whether or not “place” is selected as a condition forautomation. If the selection of “place” is determined in step S464, theflow goes to step S466 to check whether or not the date of an event heldin the place is in this month. If the date of the event is in thismonth, the flow goes to step S438 with the selection of “place” madevalid as the condition. In this case, all the pictures relating to theplace identified in area 206 in FIG. 17 are picked up in step S438.

On the other hand, if it is not determined in step S464 that “place” isselected as a condition for automation, the flow goes to step S468.Further, if it is not determined in step S466 that the date of the eventis in this month, the flow also goes to step S468. In step S468, it ischecked whether or not “day of the week” is selected as a condition forautomation. If the selection of “day of the week” is determined in stepS468, the flow goes to step S470 to search into unprepared automationdata for picking up picture with the day of the week of the shootingdate in area 204 corresponding to that designated in area 226 in FIG.17. In step S470, one day is set as the intromission day for each of thepicked up images, the flow then going to step S450. Since the same dayof week is repeated every week without time limit and the number ofintromission day is naturally one, the flow directly goes from step S470to S450 without such an adjustment in the number of intromission days asin steps S440 to S448.

If it is not determined in step S468 that “day of the week” is selectedas a condition for automation, the flow goes to step S418 in FIG. 21. Inother words, if no selection of condition for automation slideshow isdetected in any of steps S434, S436, S460, S464 and S468, the flowdirectly goes to Step S418 without preparing selection of pictures forautomation slideshow for the time regardless of the detection ofunprepared image data in step S432. Further, if it is not detected instep S462 or step S466 that the birthday of the designated person or thedate of an event held in the place is in this month, the flow leads toStep S418 by way of step S468 without preparing selection of picturesfor automation slideshow for the time being to wait for the nextoccasion.

The functions and the advantages thereof explained above are not limitedto the embodiments described above, but are widely applicable to othervarious embodiments. According to the enlarge/scroll process describedin FIG. 12, for example, digital camera 2 calculates the scale ofenlargement for displaying the picture on monitor 11 with the actualsize just the same as that of the picture to be displayed on electronicpaper monitor 6 on the basis of the size of electronic paper monitor 6transmitted from electronic paper display 4 and the rate of the areaoccupied by the horizontally or vertically long picture to the entirearea of the calendar layout. However, the scale of enlargement fordisplaying the picture on monitor 11 with the actual size just the sameas that of the picture to be displayed on electronic paper monitor 6 canbe calculated in electronic paper display 4 and be transmitted todigital camera 2 if electronic paper display 4 has been informed ofcalendar layout information or standardized calendar layouts are totallyshared in the system including digital camera 2 and electronic paperdisplay 4. By the way, the feature of displaying the picture on monitor11 with the actual size just the same as that of the picture to bedisplayed on electronic paper monitor 6 is applicable not only to thecase of displaying the picture in the calendar layout, but also to thecase of displaying the picture alone on a digital photo frame which isanother example of image display device. The typical functions and theadvantages of the image visualizing device are described in the summaryof the invention of this specification. But other features, elements,arrangements, steps, characteristics and advantages according to thisinvention can be readily understood from the detailed description of theabove explained preferred embodiments in conjunction with theaccompanying drawings, which can be widely applicable to other variousembodiments.

On the other hand, the followings are summary of typical functions andthe advantages of the image output device. Similarly in the case ofimage display device, various features, elements, arrangements, steps,characteristics and advantages according to this invention not mentionedbelow can be readily understood from the detailed description of theabove explained preferred embodiments in conjunction with theaccompanying drawings, which can be widely applicable to other variousembodiments.

Preferred embodiment of this invention provides an image output devicecapable of cooperating with a predetermined outside image visualizingdevice for visualizing the picture in a known size. The image outputdevice comprises a storage arranged to store digital image data of apicture to be visualized by the outside image visualizing device, anoutput portion arranged to output the digital image data stored in thestorage to outside of the image output device, a monitor arranged tomonitor the picture on the basis of the digital image data to be outputfrom the output portion, the size of the monitor being less than that ofthe size of the picture visualized by the outside image visualizingdevice, and a controller arranged to have the monitor display a part ofthe picture with such a scale of enlargement that the part of thepicture is enlarged in the size corresponding to that of the picture tobe actually visualized by the outside visualizing device. According tothe feature of the embodiment, confirmation of the details on thepicture to be used in the cooperating outside image visualizing devicecan be facilitated in the image output device.

In a detailed design according to the above preferred embodiment, theimage output device further comprises an image capturing portionarranged to capture digital image data to be stored in the imagestorage. A typical example of such an image output device is a digitalcamera. On the other hand, a typical example of the outside imagevisualizing device is a digital calendar display.

According to another detailed design according to the above preferredembodiment, the image output device further comprises a pointer arrangedto point the part of the picture to be enlarged. This feature isadvantageous to confirm the part of the picture in question.

In a still another detailed design according to the above preferredembodiment, the controller is arranged to determine the scale ofenlargement on the basis of information of the size of the visualizedimage and the size of the digital image data. In this respect, theinformation of the size of the visualized image can be advantageouslytransmitted from the outside image visualizing device and stored in theimage output device.

According to a more detailed design according to the above preferredembodiment, the controller is arranged to determine the scale ofenlargement further on the basis of a ratio of area occupied by thepicture to the entire area of a predetermined layout visualized byoutside image visualizing device. According to this detailed feature ofthe embodiment, confirmation of the details on the picture can befacilitated with the layout, in which the picture is incorporated, welltaken into consideration. A typical example of the layout is a calendarlayout with the picture incorporated as a part thereof.

According to another more detailed design according to the abovepreferred embodiment, the storage is arranged to store calendar dataseparated from and related with the digital image data, the calendarbeing composed of the related calendar data and digital image dataaccording to the calendar layout. According to this feature flexiblecombination between calendar data and the digital image data ispossible, which makes it possible to easily substitute the picture inthe calendar, for example.

In a still more detailed design according to the above preferredembodiment, the storage is arranged to store event data separated fromand related with the calendar data, the calendar being composed of therelated calendar data, digital image data and event data according tothe calendar layout. According to this feature flexible combinationamong calendar data, digital image data and event data is possible,which makes it possible to easily carry on a once input fixed event datasuch as a birthday to the calendars of next year and so on, for example.

According to another detailed design according to the above preferredembodiment, a pair of different ratios are selectively prepared as theratio of the area occupied by the picture to the entire layout accordingto corresponding pair of selectively predetermined calendar layoutsincorporating one of the horizontally long picture and the verticallylong picture, respectively. Thus, suitable layouts for the horizontallylong picture and the vertically long picture are realized, respectively.

In a more detailed design according to the above preferred embodiment,one of the pair of selectively predetermined calendar layouts includes apredetermined number of months of calendar different from the number ofmonths included in the other of the pair of calendar layouts. Thus,suitable calendar layouts with each of the horizontally long picture andthe vertically long picture suitably incorporated are realized,respectively.

The above design of changing the scale of enlargement is widelyapplicable in various designs as a general feature that the controlleris arranged to determine the scale of enlargement for the horizontallylong picture which is different from that for the vertically longpicture.

Preferred embodiment of this invention provides another image outputdevice comprising an image storage arranged to store digital image dataof a picture, a monitor arranged to monitor the picture on the basis ofthe digital image data stored in the storage, and a controller arrangedto incorporate the picture in a calendar layout, wherein the controlleris arranged to display the picture incorporated in the calendar layoutwith a rotational angle different from that of the same picture alone by90 degrees on the monitor. According to this design, both a horizontallylong picture alone and a vertically long calendar layout with the samehorizontally long picture incorporated are effectively displayed in fullsize on a rectangular monitor of the image output device, for example.

Preferred embodiment of this invention provides another image outputdevice comprising an image storage arranged to store digital image dataof a picture, a monitor arranged to monitor the picture on the basis ofthe digital image data stored in the storage, and a controller arrangedto incorporate the picture in a calendar layout, wherein the controllerarranged to incorporate a plurality of pictures in a common calendarlayout to compose a plurality of different months of calendars,respectively. According to this feature, a plurality of different monthsof calendars can be easily and effectively created.

Preferred embodiment of this invention provides still another imageoutput device comprising an image storage arranged to store digitalimage data of a picture, a monitor arranged to monitor the picture onthe basis of the digital image data stored in the storage, and acontroller arranged to incorporate the picture in a calendar layout,wherein the controller is arranged to incorporate the picture in acalendar including an even month calendar on the left side and an oddmonth calendar on the right side. Accordingly, a useful two-monthcalendar with one picture combined can be created.

Preferred embodiment of this invention provides still another imageoutput device comprising an image storage arranged to store digitalimage data of a picture, a monitor arranged to monitor the picture onthe basis of the digital image data stored in the storage, anacceleration sensor, and a controller arranged to have the monitordisplay a part of the picture with a scale of enlargement, wherein thecontroller is arranged to automatically scroll the part of the enlargedpicture in accordance with the acceleration sensor toward the directionopposite to the movement sensed by the acceleration sensor. Thus, thecomprehension of a wider area of the enlarged picture is facilitated dueto the retention of brain and persistence of vision.

In a more detailed design according to the above preferred embodiment,the controller is arranged to predict future acceleration on the basisof the change in acceleration of the sensed acceleration to control thescroll on the basis of the acceleration actually sensed by theacceleration sensor with the prediction taken into consideration. Thus,useful scroll is achieved for easy comprehension of a wider area of theenlarged picture.

What is claimed is:
 1. An image visualizing device comprising: a storagearranged to store digital image data of a plurality of pictures to bevisualized; a display arranged to visualize one of the plurality ofpictures on the basis of the digital image data retrieved from thestorage; an analyzer arranged to analyze the digital image data of theplurality of pictures; and a controller arranged to automatically changethe term, during which the picture is visualized on the display, inresponse to the analyzer.
 2. The image visualizing device according toclaim 1, wherein the analyzer is arranged to automatically count thenumber of the plurality of pictures, and wherein the controller isarranged to automatically change the term per one picture in accordancewith the number of the pictures counted by the analyzer.
 3. The imagevisualizing device according to claim 2, wherein the analyzer isarranged to automatically count the number of the plurality of pictureswithin a period, and wherein the controller is arranged to automaticallychange the term per one picture in accordance with the number of thepictures within the period.
 4. The image visualizing device according toclaim 3, wherein the controller is arranged to automatically reduce thenumber of pictures capable of being visualized on the display when theterm per one picture is less than a limit due to an excessive number ofthe pictures within the period.
 5. The image visualizing deviceaccording to claim 4, wherein the limit is one day long.
 6. The imagevisualizing device according to claim 5, wherein the period is onemonth.
 7. The image visualizing device according to claim 1, wherein thedigital image data of a picture is related to attribute data, whereinthe analyzer is arranged to automatically check the attribute data, andwherein the controller is arranged to automatically change the term ofvisualizing the picture in accordance with the attribute related to thepicture checked by the analyzer.
 8. The image visualizing deviceaccording to claim 1, wherein the analyzer is arranged to automaticallydistinguish a temporal picture from a regular picture, and wherein thecontroller is arranged to automatically substitute the temporal picturefor the regular picture for a term and to get back the regular picturein place of the temporal picture when the term expires.
 9. The imagevisualizing device according to claim 1, further comprising an outputarranged to inform outside of the visualizing device of the size of thepicture on the display.
 10. The image visualizing device according toclaim 9, wherein the size of the picture is determined in accordancewith the size of the display and the layout for arranging the picture ondisplay.
 11. The image visualizing device according to claim 10, whereinthe layout is calendar layout with the picture incorporated.
 12. Theimage visualizing device according to claim 11, wherein the calendarlayout includes a first calendar layout for a horizontally long pictureand a second calendar layout for a vertically long picture.
 13. Theimage visualizing device according to claim 11, wherein the calendarlayout includes an even month calendar on the left side and an odd monthcalendar on the right side.
 14. The image visualizing device accordingto claim 11, wherein the display includes an electronic paper display.15. An image visualizing device comprising: a storage arranged to storedigital image data of a plurality of pictures to be visualized andcalendar data; an electronic paper display arranged to visualize acalendar with the picture incorporated in accordance with a calendarlayout on the basis of the digital image data and calendar dataretrieved from the storage; and a controller arranged to prepare a firstcalendar layout for a horizontally long picture and a second calendarlayout for a vertically long picture for automatically selecting one ofthe first and second calendar layouts in response to whether the pictureincorporated in the calendar layout is horizontally long or verticallylong.
 16. The image visualizing device according to claim 15, whereinthe size of the picture incorporated in the first layout differs fromthat in the second layout.
 17. The image visualizing device according toclaim 15, wherein the number of months displayed in the first layoutdiffers from that in the second layout.
 18. An image visualizing devicecomprising: a storage arranged to store digital image data of aplurality of pictures to be visualized and calendar data; an electronicpaper display arranged to visualize a calendar with the pictureincorporated in accordance with a calendar layout on the basis of thedigital image data and calendar data retrieved from the storage; and acontroller arranged to prepare a calendar layout with an even monthcalendar arranged on the left side and an odd month calendar on theright side.
 19. The image visualizing device according to claim 18,wherein the calendar layout includes a picture area with one picturecommonly arranged for two months and a calendar area with even monthcalendar and the odd month calendar arranged side by side beneath thecommonly arranged one picture.
 20. The image visualizing deviceaccording to claim 18, wherein the controller is arranged to furtherprepare another calendar layout with an odd month calendar arranged onthe left side and an even month calendar on the right side.